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ABSTRACT 



This report is concerned with the validity of ACT test scores and self-reported 
high school grades for predicting grades in specific college freshman courses. 
Specific course grade predictions are typically used to place students in remedial, 
standard, or advanced classes. These placement decisions, in turn, have immediate 
implications for student performance, satisfaction, and persistence in college. 

Prediction equations were developed for 18 specific college courses in English, 
mathematics, social studies, and natural sciences using ACT research data from 1980 
to 1984. The predictive accuracy of these equations was then examined using cross- 
validation techniques. An additional analysis determined whether the predictive 
validity statistics varied among types of institutions. Implications of the results 
for course placement were examined. 




PREDICTING GRADES IN SPECIFIC COLLEGE FRESHMAN COURSES 
FROM ACT TEST SCORES AND SELF-REPORTED HIGH SCHOOL GRADES 



Through ACT's Standard Research Service (SRS), postsecondary institutions can 
develop predictions of tneir students 9 grades in specific freshman courses. These 
predictions are based on the students 1 ACT subtest scores (in English, mathematics, 
social studies, and natural sciences) and on their self -reported high school grades 
in the same subject areas: 

(1) Y = a 0 + aj*ACT English Usage score 

+ a 2 *ACT Mathematics Usage score 

+ a 3 *ACT Social Studies Reading score 

♦ a^ACT Natural Sciences Reading score 

♦ a 5 *HS English grade 

+ a 6 *HS Mathematics grade 

+ a 7 *HS Social Studies grade 

+ a 8 *HS Natural Sciences grade 

In this equation, Y is the predicted course grade and a Q ,...,a 8 are regression 
weights unique to the institution and to the course grade being predicted. The 
weights are calculated from the college course grades supplied by each institution 
through its participation in SRS, and from students 1 ACT test scores and high school 
grades. Institutions may choose to base their predictions on the ACT test scores 
alone, but rarely do so. 



About 150 institutions each year develop prediction equacions for specific 
course grades. The regression weights are reported to the institutions; the weights 
may then be used, through Equation (1), to calculate predicted grades for future 
students. At the request of the institutions, ACT also reports predictions in terms 
of grade expectancies (chances of earning a given grade or higher) on the ACT score 
reports of future students. For details on how ACT calculates grade expectancies, 
see Your College Freshmen (ACT, 981). 

Specific course grade predictions are typically used for course placement. For 
example, students with low predicted chances of success in a standard freshman Eng- 
lish course iright be advised or required to enroll in a remedial English course. On 
the other hand, students with high predicted chances of success in an honors English 
course might be encouraged to enroll in it. In this paper we present evidence sup- 
porting the use of ACT scores and high school grades for placement in first-year 
English, mathematics, social studies, and natural sciences courses at the postsecon- 
dary level. 

We assume that the placement decision is based on a specific course grade 
prediction equation like Equation (1). Moreover, the selection rule is assumed to 
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have the following general form: If a student has a small predicted chance of suc- 
ceeding at a given level of a course, then the student is selected for a lower level. 
Not all colleges' placement procedures have this form; our choice of placement model 
for this discussion is based on the belief that it yields the most relevant predic- 
tions. The other placement procedures tend to be used for their practical advantages, 
such as their greater ease of operation, or their greater ease of explanation to 
staff and students. 

The justification for using ACT test scores and high school grades for place- 
ment rests on the following basic assumptions: 

1. Successful work in any college course requires that students have 
previously acquired a set of academic skills and knowledge particular 
to the course. 

2. ACT test scores and high school grades either directly measure or are 
closely related to the required skills and knowledge. 

3. The college course grades are of sufficient reliability and validity 
so that they measure real and relevant educational outcomes, rather 
than random or irrelevant factors. 

The degree to which these assumptions are true affects the accuracy of specific course 
grade predictions. Prediction accuracy is therefore a relevant factor in determining 
the suitability of using ACT test scores and high school grades for placement. For 
further discussion of how prediction accuracy and other factors are related to the 
outcomes of placement decisions based on grade predictions, see Sawyer (1987). 

Each year ACT publishes the Research Services Summary Tables (ACT, 1985), which 
summarize data collected through SRS during the previous 3 years. The Research Ser- 
vices Summary Tables contain (among other information) frequency distributions of 
correlation coefficients and standard errors of estimate for predicting grades in 
English, mathematics, social studies, and natural sciences courses. These distri- 
butions are derived from the regression statistics developed for the individual in- 
stitutions that participated in SRS. 

The predictive validity data provided in the Summary Tables pertain to broad 
subject areas, rather than to specific kinds of courses. For example, the tables do 
not provide information on how well ACT Assessment da* a predict grades in English 
composition, analytic geometry, or history, but instead only in the broad areas of 
English, mathematics, and social studies. The major purpose of this study was to 
collect predictive validity data with respect to more specific course groupings than 
are provided in the Summary Tables. 

In the actual operation of the ACT Research Services, prediction equations 
developed from the grades of one freshman class are applied to future freshman 
classes. Because these classes may differ in their test scores, high school grades, 
or college grades, predictive validity statistics developed from a single year's 
data may be overly optimistic. In crossvalidation, predictions calculated from 
equations developed from one freshman class are compared to the grades earned by a 
subsequent class. This procedure models the actual use of prediction equations by 
institutions, and avoids the tendency of estimates of predictive accuracy based on a 
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single year's data to be overly optimistic. A second purpose of this study, there- 
fore, was to determine the crossvalidated predictive accuracy of specific course 
grade predictions. 

Earlier Research 

Numerous studies have examined the relationships between admissions and place- 
ment te:it scores and specific course grades. Predictor variables have included ACT 
scores, SAT scores, and high school grades, as well as subject-specific tests, like 
the Nelson-Denny Reading Test. These studies, however, were limited in two important 
respects. First, the data the authors used were predominantly from single institu- 
tions (we found only one study that used data from two institutions). Second, the 
criteria examined in the studies were either grades from a single specific course, 
or grades from a small cluster of courses. None of the studies examined a full 
spectrum of specific courses representative of freshman curricula. In addition, the 
content of these courses was often not specified in sufficient detail to permit com- 
paring the results across institutions or courses. 

The existing research published since 1970 that we wtre able to find is sum- 
marized by subject area in Table 1. The course grade used as a criterion, the 
author(s) and date of publication, the predictor variables, the sample size, and the 
correlation coefficient are presented for each study. For a complete description of 
the predictor variables used in a each study, see the specific articles cited. 

For the English predictive validity studies, the correlations between test 
scores and English course grades were generally low; they ranged from .13 to .38. 
The one exception was a study by Gorrell (1983), which reported a correlation of .61 
between ACT English scores and final English essay ratings. 

The mathematics validity studies comprised a large proportion of the research 
on predicting specific course grades. A variety of predictors were used, including 
ACT subtest and Composite scores; SAT-V, SAT-M, and SAT-Total scores; high school 
rank; and scores on specially developed mathematics placement tests. The corre- 
lation coefficients ranged from .04 to .75; the largest correlations were associated 
with tests specifically designed for placement in machematics, as in the Bridgeman 
(1982) and Burnham and Hewitt (1971) studies. 

The studies on the relationship between social studies course grades and test 
scores generally resulted in moderate positive correlations (.32 to .52). The 
criteria for these studies, however, were limited to grades in psychology and 
sociology courses. 

The research on predictions of natural sciences grades was limited to biology, 
chemistry, and physics courses. In the studies we were able to locate, correlations 
ranging *rom .14 to .61 were reported between test scores and grades in these 
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TABLE 1 

Sumary of Earlier Research on Predicting Specific Course Grades 



Subject 



area Author(s) 


Course 


Predictor(s) 


N 


R 


English Gorrell (1983) 


English (essay ratings) 


ACT English 


103 


.61 


Wood (1982) 


English 


ACT Composite 


919 


.24 




Speech 


ACT Composite 


719 


.21 


Schoenfeldt and Brush (1975) 


Speech/ Journa 1 i sm 


SAT-Verbal 


1032 


.23 




Speech/ Journal i sm 


SAT-Mathematics 


1032 


.13 


Burnham and Hewitt v 1971 ) 


English 


SAT-V, pred. CPA, 


25 


• 22 






CEEB-Eng. , 










Adv. PI. -Eng. 








English 


SAT-V, pred. CPA, 


87 


• 38 






CEEB-Eng • , 










Adv. PI. -Eng. 






Mathematics Edge and Friedberg (1984) 


Calculus 


ACT English 


392 


• 25 




Calculus 


ACT English 


397 


.27 




Calculus 


ACT Mathematics 


392 


• 36 




Calculus 


ACT Mathematics 


397 


.47 




Calculus 


ACT Composite 


392 


• 30 


Bridgeman (1982) 


Preparatory College Math 


SAT-M, DTMS 


48 


.04, .41 




Elementary Algebra 


SAT-M, DTMS 


73 


.21, .46 




Elementary Algebra 


SAT-M, DTMS 


1 A A 

198 


•26, .47 




Math Analysis 


SAT-M, DTMS 


41 


• 18, .52 




I? 1 0 ma t> A ^ \r l?iin^ f" i An a 

CiiciucnLar y r unctions 


QAT-M HTMQ 
OAi n, uiriu 


40 


.39 .37 




Calculus 


SAT-M, DTMS 


19 


.55, .75 




Elementary Algebra 


SAT-M, HS Algebra Grades 


162 


. 36 


Troutman (1978) 


Finite Math 


SAT-Mathematics 


123 


.40 


Gussett (1974) 


Mathematics 


SAT-Verbal 


142 


.48 




Mathematics 


SAT-Mathematics 


142 


.62 




Mathematics 


SAT-Total 


142 


.63 


Kohler (1973) 


Algebra 


Cooperative Math. Test 


158 


.53 




Algebra 


ACT Mathematics 


161 


.52 




Algebra 


ACT Composite 


161 


.40 


S 
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TABLE 1 



Summary of Earlier Research on Predicting Specific Courae Grades 

(Continued) 



Subject 
area 



Author (s) 



(Mathematics continued) 

Burnhair and Hewitt (1971) 

Howlett (1969) 



Social Studies 



Wood (1982) 

Gerov and Murphy (1980) 
Zimmerman, Wise, and South 
(1974) 



Natural Sciences Craney and Armstrong (1985) 



Crooks (1980) 



Course 


Predictor(s) 


N 


R 


Mathematics 


SAT-M AHv PI -Miifk 
afti n, AOVt ri • natil. 


9 1 


&A 
• Oh 


Mathematics 


ot\L rif AaVt ri • nain* 


7 i 


• 41 


Mat hema tics 




JU 


on 
• 39 


Analytic Geometrv 

• ** « T « ^ W Will w W £. V 


APT Marh HQ Ronl/ 
Avi no Lily no noiiK 


107 


• Jo 


Analvtic Ceometrv 

nim i j Li v Uv VIII w c L y 


APT Mflhl-I UC Donlr 

avjL nacn, no tianK 


A07 


• 47 


Psychology 


ACT Composite 


738 


.43 


Sociology 


ACT Composite 


899 


.32 


PflVChol QffV 


Mai enn>Tlonnv 

nei s on Denny 


Jo Uo 


•40-.o4 


Psvchol Offv 


APT Prt a 1 { ali 


i &a 


• 40 


Psvchol Ottv 


APT Miifliomfl^ i ra 

nui nam em at. ics 


1 &A 
LOH 


• Jo 


Psvcholosv 


APT Qnri ill QfiiH-tea 


1 AA 


AO 
• HZ 


Psvchol oav 


APT NjlfnrJil Qri 0nr«a 


1 AA 


CO 

• J J 


Psychology 


APT Hnmnnftifp 


1 AA 


C£ 

• JD 


Chemistry 


Toledo Exam 

****** WW UAOIU 


JU*t 


• j* 


Chemistry 


SAT-Mathematics 


304 


.45 


Chemistry 


HS Chemistry grad 


304 


.39 


Chemistry 


Toledo Exam, SAT-M 


304 


.61 


Chemistry 


HS Chemistry grade 


304 


.61 


Physics 


ACT Composite 


495 


.40 


Physics 


SCAT-Q, HS-PR, 








ACT-M, ACT-NS 


495 


.54 


Physics 


ACT-C, HS-PR 


495 


.48 
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TABLE 1 



Sunmary of Earlier Research on Predicting Specific Course Grades 

(Continued) 



Subject 
area 



Author(s) 



Course 



Predictor(s) 



N 



(Natural Sciences continued) 



Ozsogomonyan and Loftus (1979) 
Pederson (1975) 



Schoenfeldt and Brush (1975) 
Reiner (1971) 



Chemistry 
Chemistry 
Chemistry 
Chemistry 

Biological Sciences (GPA) 
Biological Sciences (GPA) 
Chemistry 



SAT-Mathematics 

SAT-Verbal 

SAT-Mathematics 

SAT-Total 

SAT-Verbal 

SA1 * thematic s 

ACT Math, HS Rank 



1148 
325 
325 
325 
1854 
1855 
250 



.51 
.32 
.14 
.43 
.30 
c28 
.53 
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Data for the Study 

This study was based on student records submitted by institutions that par- 
ticipated in ACT's Standard Research Service (SRS) between 1980 and 1984. Each 
student record contained ACT subtest scores and self-reported high school grades in 
the areas of English, mathematics, social studies, and natural sciences. In addi- 
tion, each record contained an ACT Composite score (the average of the four subtest 
scores) and a high school average (the average of che four self-reported high school 
grades). ACT test scores are reported on a standard scale ranging from 1 to 36; 
high school grades are reported on a 0(F) to 4(A) scale. Additional descriptive and 
technical information about ACT test scores and self-reported high school grades may 
be found in The ACT Assessment Program Technical Manual (1987). 

Each student record also contained grades for one or more specific freshman 
courses chosen by the individual institutions. Most institutions, when submitting 
their documentation to the SRS, used names like "Math 101" or "Freshman English 11 to 
identify their course grades. To develop predictive information for specific types 
of courses within general subject areas, it was necessary to determine the contents 
of individual courses. This war accomplished by surveying "he SRS participants. 

To determine the types of courses that could be studied, we reviewed the SRS 
reports produced between 1980 and 1984 and listed all of the freshman courses for 
which prediction equations were developed. From the 277 institutions that par- 
ticipated in SRS between 1980 and 1984, we identified 2,918 courses and organised 
them into six general content categories: English, foreign languages, Mathematics, 
social studies, natural sciences, and miscellaneous. 

We next examined the catalogs from several of the SRS participating insti- 
tutions to determine the contents of the courses. Using this information, we 
developed a taxonomy of course content codes. This taxonomy served as the basis 
for identifying the contents of the courses reported by the other SRS participants. 
(See Append i* A for a list of content codes.) 

Other factors were also considered in identifying courses. In several cases, 
institutions reported grades for developmental/remedial courses or honors courses in 
addition to, or instead of* standard freshman courses. Furthermore, some courses 
were specific to a particular discipline, particularly in agriculture, business, 
engineering, and health sciences. For example, Business Math may have had content 
similar to the typical Algebra I course, and as such, was assigned the content code 
Ml. However, because the material in the course emphasized business applications, a 
business emphasis was also identified. Thus, two additional sets of codes were 
created, one to identify the placement level of the course, and the other to identify 
the disciplinary emphasis. 

Several of the courses reported by the institutions were not specific courses, 
per se, but were combinations of cours s. For example, some colleges pooled the 
gr&v 4 is of all students enrolled in different courses and reported them under a 
single course heading. Other institutions reported for each student a grade point 
average computed from several related courses. To differentiate these types of 
course grades from specii^c course grades, an additional set of course identifiers 
was created. 

Each participating institution received a questionnaire that listod the names 
of the specific courses it had studied through SRS, as well as the year, number of 
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students, and SRS course grade area (E, M, S, or N). Institutional personnel were 
tfren asked to select for each course the specific code or codes that best identified 
the course content. In addition, they were requested to check the pooled or GPA 
columns if the grades were from multiple courses, and to specify the placement level 
and disciplinary emphasis codes for each course. Finally, they were asked to respond 
to two additional items concerning their use of predictive information for course 
sectioning and placement. 

A pilot questionnaire, cover letter, and directions were submitted to three SRS 
users to review and to complete. Copies were also distributed to ACT staff for re- 
view and comment. Following the pi lor - is ting, the comments and suggestions u£ •'he 
reviewers were studied, and a final qu cionnaire form was developed. Examples of 
the questionnaire, instruction sheet, and cover letter are contained in Appendix B. 

Questionnaire forms were mailed in October 1985 to the 277 institutions that 
participated in SRS between 1980 and 1984 and that had developed prediction equa- 
tions for specific courses. Institutions that failed to respond by the return date 
of November 15 were contacted initially by letter, and then by telephone, where 
necessary. Of the 277 questionnaires mailed, 210 (or 76Z) were returned. Of that 
number, nine were unusable; either institutional personnel were unable to provide 
the information requested or all of the grades reported were pooled from several 
areas, rather than from specific courses. We were able, however, to identify the 
content of the courses from 23 of the 67 non-responding institutions by examining 
their catalogs. As a result, we obtained data for 233 (or 84%) of the 277 insti- 
tutions we surveyed. 

We next analyzed the survey data to determine the specific course grades to use 
as criterion variables. In an initial review of the data, we determined that only a 
few course grades were pooled grades or GPAs. To retain data as specific as pos- 
sible, ve deleted all pooled grades from the analysis. Moreover, we retained GPAs 
only if the grades that were averaged had the same specific course content (e.g., 
biology). The final resulting course grade data file consisted of 2,812 specific 
courses; 2,143 courses were identified by individual institutions, and 669 courses 
were identified from college catalogs. 

Frequency distributions were developed for all possible combinations of course 
content codes within each of the six subject areas (English, foreign languages, 
mathematics, social studies, natural sciences, and miscellaneous). If jt least 10 
institutions reported a particular content code, or combination of codes for a spe- 
cific course, that code or set of cMes was identified as a course group for the 
analyses. For example, courses that were coded El were assigned to the course group 
Grammar /Linguistics (see Appendix A). Those courses coded as El and E5 were assigned 
to the course group Grammar & Writing. A total of 18 separate course groups were 
identified; a list of the course groups is given in Table 2. (Note that Accounting 
was subs led under the mathematics heading; it was the only miscellaneous course with 
a sufficient number of participating institutions to warrant analysis). 

Several institutions reported grades for different courses in the same course 
group in the same year (e.g., cwo separate chemistry courses in 1984). For the 
analyses, such courses were treated as separate units of analysis. There were 95 
such courses among the 2,812 courses studied in the entire file. 
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TABU 2 

College Course Groups Selected For Prediction of Specific Course Grades 



Subject 






Area 


Code 


Description 


English 


El 


Grammar /Li ngui s i ti cs 




E5 


Writing (Creative, Expository, Journalism, etc*) 




E1E5 


Grammar/Linguistics & Writing 




E1E2E5 


Crammar/Li ngui sties & Literature (American , English, Classics. 






etc*) & Writing 




E1E3E5 


Grammar/Linguistics & Reading & Writing 


Mathematics 


Ml 


Algebra 




M4 


Calculus 




M5 


Computer Science/Numerical Analysis/Graphics 




ACCTG 


Accounting 




M1M3 


Algebra & Arithmetic Skills 




M1M9 


AlgeJra 4 Trigonometry 




M2M4 


Analytic Geometry & Calculus 


Social Studies 


S5 


History (American, World, Western Civilizations, Etc*) 




S8 


Psychology (Child, Abnormal, Adult, etc*) 




S10 


Sociology 




S5S7 


History & Political Science (World Problems, Theory, etc*) 


Natural Sciences 


N3 


Biology/Life Sciences/Microbiology 




N5 


Chemistry 



9 

eric 
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For each subject area (English, mathematics, social studies, and natural sci- 
ences), the questionnaire data were matched, by year and ACT college code, with 
individual student records from the SRS data flies. The resulting matched file 
contained the questionnaire course group information and each student's college 
grades, ACT subtest scores, self-reported high school grades, and demographic and 
background characteristics. The final file contained one or more years' data for 
576 distinct courses distributed across 18 course groups and 233 institutions. 

It should be noted that because the data in this study were collected from 
institutions participating in the ACT predictive research services, they are in 
some respects not representative of students nationally? 

* Colleges using the ACT Assessment are located mainly in the Rocky 
Mountains, Great Plains, Southwest, Midwest, and South, with 
comparatively fewer on the East Coast and West Coast. 

* Public institutions are relatively over-represented among colleges 
that use the ACT Assessment, and private institutions are under- 
represented. 

* Participation in ACT's predictive research services is voluntary, and, 
as such, the colleges represented are self-selected even among col- 
leges that use the ACT Assessment. 

Therefore, the results of the study cannot be claimed to represent precisely the 
results that would be obtained if data from all colleges in the United States could 
somehow be collected. 

Method 

The analysis of the specific course data was conducted in two parts. In the 
first part, we computed regression statistics for each specific course grade using 
the most recent year's data from each institution. This was done to maximize the 
numbers of institutions and students for which prediction equations could be cal- 
culated. In the second part of the study, we crossvalidated prediction equations 
for ourses from institutions where more than one year's data were available. 

In both parts of the study, the predictor variables were the four ACT subtest 
scores and the four self-reported high school grades in the corresponding subject 
areas. The criterion variables were grades from the 18 specific course groups 
identified from the questionnaire data. Both high school and college grades were 
reported on a 0.0-4.0 scale. 

As is usually the case in predictive validity studies, the college grades 
collected for this study may reflect prior selection or treatment made on the basis 
of the predictor variables. For example, in colleges that used test scores and high 
school grades for course placement, the students' grades reflect these interventions. 
VRure placement has occurred, the variability in predictor variables among students 
in the course will be less than the variability among all freshmen, had they enrolled 
in the course. As a result, the predictive validity statistics for the course grades 
underestimate the relationship between the predictor variables and the criterion in 
a population where intervention does not take place* 
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Part 1 (Analysis of Predictions Based on Most Recent Data) 

For each college, multiple linear regression prediction equations were calcu- 
lated using the most recent year's data for each course group in each college. There 
were 576 separate courses across all course groups and colleges. The predictor vari- 
ables were ACT subtest scores and self-reported high school grades used in three 
combinations: 

(a) four ACT subtests, 

(b) four high school grades, and 

(c) four ACT subtest scores and four high school grades. 

Descriptive statistics were also calculated for the specific course grades, ACT 
Composite scores, high school averages, and student sample sizes from each insti- 
tution. The regression and descriptive statistics were then summarized across 
institutions. Regression and descriptive statistics based on student sample sizes 
smaller than 25 were deleted from the summaries. 

For this study, the predictions using both the ACT subtest scores and high 
school grades were based on eight-variable multiple regression equations. The TH 
Index, reported in the Standard Research Summary Tables, is the average of the 
predictions based on ACT subtest scores alone and the predictions based on self- 
reported high school grades alone. Sawyer and Maxey (1979) found, however, that the 
difference in the predictive accuracy of the two methods is negligible* 

We calculated for each prediction equation the associated multiple correlation 
(R) and standard error of estimate (SEE). R ranges from 0 to 1, with larger values 
indicating more accurate prediction. SEE is the square root of the average squared 
difference between actual and predicted course grades. (In order that it have the 
statistical property of being "unbiased, 11 SEE is calculated by dividing the sum of 
squared differences by N-p-1, where N is the sample size and p is the number of 
predictors, rather than dividing it by N.) Smaller values of SEE indicate more 
accurate prediction. 

Neither R nor SEE completely and directly measures the overall effectiveness of 
a placement system in making correct decisions; determining this would require know- 
ledge of the overall failure rate that would occur in the absence of a placement 
system, as well as the selection rate for each course section, and the costs and 
benefits of correct and incorrect placement decisions. Nevertheless, both statis- 
tics are relevant to the overall validity of a placement system because they measure 
prediction accuracy. Other things being equal, a placement system based on more 
accurate predictions will be more valid than one based on less accurate predictions. 
For a discussion of variables affecting placement validity and how they are related 
to R and SEE, see Sawyer (1987). 

Correlations between predictive validity statistics and mean test scores and 
grades . We also determined whether Khe mean course grade, ACT Composite score, or 
high school average of students enrolled in a course was related to the predictive 
validity statistics for the course. This information provides one way for insti- 
tutional personnel to determine the applicability of the predictive validity results 
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to their particular institution. We therefore computed for each course the corre- 
lation of mean course grade, mean ACT Composite score, and mean high school average 
with the multiple R and SEE associated with the ACT ♦ HSG model. 

Stati stical theory would lead one to expect that the standard deviations of 
course grade, ACT Composite score, and high school average would also be related to 
thepredictive validity statistics. To keep the scope of this study within reason- 
able bounds, we have deferred to the future an analysis of standard deviations. 

Part 2 (Crossvalidation Analysis) 

We selected from the original data file courses from all institutions for which 
data were available for two or more years, and for which there was at least one year's 
lag between the base year and the crossvalidation year (e.g., 1980-81 and 1982-83). 
The reason for the lag in time is that prediction equations developed from a given 
year's data are, in actual practice, applied to freshmen 2 to 4 years Later. As in 
Part 1, the minimum sample size for each institution was set at 25 for each year. Of 
the original pool of 18 course groups taken from 576 specific courses from 233 insti- 
tutions, 10 course groups from 208 institutions were identified. 

The three combinations of predictor variables described in Part 1 above were 
also used in this portion of the study. For each combination of predictors, we used 
the regression equations developed from the base year data to predict th. grades of 
students enrolled in the same course during the crossvalidation year 2 to 4 years 
Later. We then compared the predicted and actual grades observed during the cross- 
validation year and computed the following measures of prediction accuracy for each 
college and specific course: 

* RMSE (observed root mean squared error), the square root of the average 
squared difference between predicted and earned specific course grades. 
Smaller values of RMSE correspond to more accurate prediction than do 
larger values of RMSE. This statistic can be compared with the standard 
error of estimate calculated from the base year data to give an indica- 
tion of the stability of the predictions over time. 

* CVR (cross validated correlation), the Pearson correlation between predicted 
and earned specific course grades. This coefficient can be compared with 
the multiple correlation coefficient calculated from the base year data to 
give an indication of the stability of the predictions over time. 

* BIAS (prediction bias), the average difference between predicted and earned 
specific course grades. Positive values of BIAS correspond to overpredic- 
tion, and negative values correspond to underprediction. 

These crossvalidation statistics were summarized across institutions for each specific 
course group. 

Results 

Part 1 (Analysis of Predictions Based on Most Recent Data) 

Descriptive statistics . Tables 3 through 6 contain descriptive statistics for 
the courses from institutions in each specific course group. The number of colleges 
in each course group is reported, along with the minimum, median, and maximum of the 
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following institutional statistics: mean and standard deviation ot course grade; 
mean and standard deviation of ACT Composite score; and mean and standard deviation 
of high school average. 

The means for each course group were compared to analogous data reported in the 
3-year Research Services Summary Tables for 1981 through 1984 (ACT, 1985). The Sum- 
mary Tables are based on data obtained from all institutions that participated in 
SRS during those years (number of colleges = 262; number of students = 191,626). For 
institutions that participated more than once, only the most recent year's data are 
included. The median institutional mean ACT Composite score from these 3-year norms 
was 19.4, and the median institutional high school average was 2.95. The median in- 
stitutional mean course grades were: English, 2.49; mathematics, 2.38; social studies, 
2.41, and natural sciences, 2.26. By comparing these medians with the descriptive 
statistics in Tables 3-6, one can judge how similar the students who enrolled in spe- 
cific courses were to students in general. 

As shown in Table 3, the median English course grade means were within 0.2 grade 
units of the median English grade averages from the 3-year norms. As measured by 
their median ACT Composite mean scores, students enrolled in Grammar, Grammar & 
Writing, and Grammar & Literature & Writing courses were less academically able than 
students in general (for whom the median institutional mean was 19.4), and students 
enrolled in Writing courses were more able. The median high school average means for 
all the English course groups were close to the 3-year norms median of 2.95. 

According to the results in Table 4, median course grades for all mathematics 
courses (except for Algebra & Arithmetic Skills and Computer Science) were similar 
to the Summary Table median of 2.38. The grades in Algebra & Arithmetic Skills 
courses (median = 1.83) tended to be lower than those in the Summary Tables, while 
the grades in Computer Science courses (median = 2.66) tended to be higher. The 
median ACT Composite mean score for students enrolled in Algebra & Arithmetic skills 
indicate that they were less academically able than students in general; the median 
ACT Composite means for Calculus (24.8), Analytic Geometry & Calculus (24.8), and 
Algebra & Trigonometry (21.8) indicate that students enrolled in those courses were 
more academically able. The median statistics for the other mathematics courses 
were all closer to the medians in the Summary Tables. 

The results for the social studies course groups, reported in Table 5, were 
similar to the results from the Summary Tables. For the Chemistry course group, 
summarized in Table 6, the median ACT Composite score (22.5) and high school average 
(3.26) were higher than the corresponding medians in the Summary Tables for natural 
sciences courses. The corresponding medians for Biology were similar to those in 
the 3-year norms. 
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TABLE 3 

Distribution, Across Colleges , of Means and Standard Deviations 
of College Course Grade, ACT Composite Score, 
and High School Average for English Courses 









Number 


Course 


ACT 




High school 




Number 




of students 


grade 


Composite 


avers 


ge 


iiUUioc group ox 


con eges 


Oit ant* « 1 a 

vjuanc lie 


in course 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Grammar 


29 


Min. 


74 


1.47 


.66 


1 A A 

10.9 


2 .54 


2.24 


.41 






Med. 


254 


2.32 


.97 


18.4 


4.66 


0 OA 


AS 
.0 J 






Mav 

nax • 




3.09 


1.22 


23.2 


5.46 


3.35 


.75 


Writing 


46 


Min. 


57 


2.07 


.63 


10.1 


2.78 


2.31 


.41 






Med. 


264 


2.63 


.87 


20.5 


4.48 


3.05 


.60 






Max. 


3876 


3.34 


1.21 


25.2 


5.45 


3.42 


.71 


Grammar & Wri* ing 


54 


Min. 


33 


1.75 


.73 


11.0 


3.70 


2.37 


.51 




Med. 


283 


2.46 


.92 


17.9 


4.65 


2.95 


.62 






Max. 


1832 


3.09 


1.31 


25.2 


5.51 


3.33 


.79 


Grammar 


20 


Min. 


97 


1.77 


.61 


15.5 


3.23 


2.60 


.49 


& Literature 




Med. 


393 


2.49 


.92 


17.8 


4.79 


2.91 


.64 


& Writing 




Max. 


2283 


2.87 


1.22 


23.6 


5.66 


3.28 


.74 


Grammar & Reading 


14 


Min. 


75 


1.93 


.63 


13.5 


3.15 


2.51 


.56 


& Writing 




Med. 


342 


2.44 


.93 


18.7 


4.56 


2.89 


.62 






Max. 


1097 


2.67 


1.14 


21.3 


5.58 


3.11 


.89 
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TABLE 4 



Dittribution f Across Colleges, of Means and Standard Deviations 
of College Course Grade, ACT Composite Score* 
and High School Average for Mathematics Courses 



course group or 


Number 
coi leges 


yuan ci le 


Number 
of students 
in course 


Course 
grade 
.Mean SD 


ACT 
Composite 
Mear SD 


High school 
average 
Mean SD 


Al gebra 


69 


Min. 


52 


1.38 


.91 


12.8 


3.24 


2.48 


.51 






Med. 


215 


2.26 


1.22 


18.7 


4.41 


2.96 


.61 






Maw 




2.75 


1.50 


23.5 


6.04 


3.41 


.75 


Calculus 


20 


Min. 


60 


1.83 


.86 


21.4 


1.91 


2.92 


.33 






Med. 


161 


2.42 


1.12 


24.8 


3.59 


3.39 


.48 






May 

nax • 


i nno 

1 UU7 


2.77 


1.37 


28.4 


4.40 


3.73 


.62 


Computer Science 


11 


Min. 


55 


2.10 


1.00 


17.6 


3.36 


2.71 


.43 






Med. 


103 


2.66 


1.13 


21.4 


A. 39 


2.95 


.59 






nax . 




2.74 


1.40 


25.6 


3.18 


3.46 


.78 


Accounting 


10 


Min. 


46 


1.82 


.90 


15.3 


3.82 


2.62 


.50 






Med. 


129 


2.28 


1.25 


18.0 


4.54 


2.94 


.56 






Max. 


510 


3.11 


1.54 


23.3 


5.34 


3.30 


.72 


Algebra 


11 


Min. 


37 


1.20 


.97 


14.3 


3.48 


2.51 


.51 


& Arithmetic 




Med. 


166 


1.83 


1.28 


17.4 


4.28 


2.83 


.59 


Skills 




Max. 


490 


2.94 


1.46 


22.5 


5.26 


3.18 


.79 


Algebra 


12 


Min. 


56 


1.78 


.94 


15.4 


2.36 


2.61 


.43 


& Trigonometry 




Med. 


232 


2.19 


1.17 


21.8 


3.75 


3.18 


.56 






Max. 


1189 


2.67 


1.35 


24.6 


5.56 


3.41 


.64 


Analytic Geometry 


10 


Min. 


63 


1.78 


.94 


16.0 


3.10 


2.83 


.43 


& Calculus 




Med. 


152 


2.29 


1.22 


24.8 


3.81 


3.37 


.51 






Max. 


1700 


2.89 


1.44 


26.6 


5.17 


3.60 


.66 



TABLE 5 



Distribution, Across Colleges, of Means and Standard Deviations 
of College Course Grade, ACT Composite Score, 
and High School Average for Social Studies Courses 









Number 


Course 


ACT 




High school 


Course group 


Number 




of students 


grade 


Composite 


average 


of colleges 


Quant ile 


in course 


Mean 


3D 


Mean 


SD 


Mean 


SD 


History 


59 


Min. 


34 


1.33 


.59 


11.4 


2.31 


2.42 


.33 






Med. 


160 


2.26 


1.07 


18.6 


4.80 


3.03 


.64 






Max. 


1639 


3.10 


1.30 


27.4 


5.88 


3.74 


.77 


Psychology 


58 


Min. 


55 


1.41 


.56 


11.2 


1.72 


2.26 


.45 






Mfld. 


193 


2.42 


1.05 


18.5 


4.73 


2.92 


.62 








2798 


3.31 


1.32 


27.7 


5.59 


3.57 


.76 


Sociology 


18 


Min. 


43 


1.79 


.75 


15.1 


3.68 


2.48 


.47 






Med. 


353 


2.56 


.99 


18.5 


4.70 


2.92 


.62 






Max. 


976 


3.11 


1.28 


23.6 


5.46 


3.49 


.72 


History 


11 


Min. 


59 


1.86 


.91 


17.0 


2.80 


2.79 


.50 


& Political 




Med. 


466 


2.43 


1.05 


19.7 


4.89 


3.03 


.64 


Science 




Max. 


554 


2.73 


1.22 


22.3 


5.29 


3.22 


.71 



TABLE 6 



Dittribution f Across Colleges , of Means and Standard Deviations 
of College Course Grade, ACT Composite Score, 
and High School Average for Natural Sciences Courses 









Number 


Course 




ACT 




High school 




Number 




of students 


grade 




Composite 


average 


Course group 


of colleges 


Quant ile 


in course 


Mean 


SD 


"ean 


SD 


Mean SD 


Biology 


7? 


Min. 


25 


0.94 


.73 


12.2 


2.84 


2.41 .41 




Med. 


123 


2.24 


1.09 


19.0 


4.65 


3.01 .63 






Max. 


991 


2.81 


1.45 


24.0 


5.68 


3.58 .74 


Chemistry 


47 


Min. 


25 


1.22 


.76 


15.9 


2.66 


2.71 .43 




Med. 


148 


2.28 


1.07 


22.5 


4.20 


3.26 .55 






Max. 


1773 


2.86 


1.47 


26.9 


6.04 


3.58 .74 
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Predictive validity statistics . The results of the multiple regression analy- 
ses for the course groups are reported in Tables 7 through 10. In these tables, 
multiple correlations (R) and standard errors of estimate (SEE) are summarized 
across institutions within each specific course group. The tables contain separate 
statistics for each prediction model: ACT subtests only (ACT), high school grades 
only (HSG), and ACT subtests and high school grades (ACT + HSG) . 

Table 7 contains the multiple Rs and SEEs for predicting specific English 
courses. For each of the three prediction models, the multiple Rs were similar 
across the five English course groups. In addition, no large differences in SEE 
were found among the course groups. 

In comparing the three prediction models, we found that the ACT model resulted 
in slightly higher median multiple Rs (.41 to .47) than the HSG model (.38 to .46) 
for all English courses. The combined ACT + HSG model had the largest multiple Rs, 
ranging from .48 to .55. Using the combined model also resulted in smaller SEEs 
(.74 to .84), when compared to the ACT (.77 to .88) and the HSG (.78 to .89) models. 

The multiple regression statistics for predicting specific mathematics course 
grades are reported in Table 8. Of the seven mathematics course groups, Accounting 
had the largest multiple Rs (median = .56); however, differences in multiple R among 
the other course groups did not exceed .10. Mathematics course groups differed in 
their SEEs, with Algebra & Arithmetic Skills obtaining consistently larger SEEs than 
other course groups. 

No large differences were found between the multiple correlations for the ACT 
and the HSG models; median multiple Rs for both models ranged from .36 to .46. 
Multiple Rs for the combined ACT + HSG model were about .1 higher than those for the 
separate models, and ranged from .46 to .56. The standard errors for the ACT and 
HSG models were similar, with median values ranging from 1.03 to 1.20. As expected, 
the combined model showed smaller standard errors, with median values ranging from 
.99 to 1.14. 

Table 9 contains the results for predicting specific social studies course 
grades. For each of the three prediction models, the multiple Rs and SEEs were 
similar for all of the course groups. 

The median multiple Rs associated with the ACT prediction model (.42 to .49), 
were consistently larger than those associated with the HSG prediction model (.37 to 
•44), particularly for History & Political Science (ACT median multiple R = .49; HSG 
median multiple R = .38). For all specific social studies courses, the combined ACT 
+ HSG model resulted in somewhat larger median multiple Rs (.50 *o .56) and somewhat 
smaller standard errors (.83 to .90} than did the ACT or HSG models. 

The results for predicting specific natural sciences courses are reported in 
Table 10. Under both the ACT and HSG models the multiple Rs for both the Biology 
and Chemistry course groups were similar, with medians ranging from .46 to .51. The 
combined ACT + HSG model resulted in increased multiple Rs (.56 to .61), and some 
decrease in SEEs (.90 to .92), when compared to the ACT and HSG models (.95 to .98). 
In general, the ACT + HSG predictions for Biology tended to be more accurate than 
those for Chemistry. 
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TABLE 7 



Distribution, Across Colleges, of Multiple Correlation 
and Standard Error of Estimate in Predicting English Grades 



Multiple correlation Standard error of estimate 

ACT sub- High school ACT subtests and ACT sub- High school ACT subtests and 

Course group Quant ile tests only grades only high school grades tests only grades only aigh school grades 



Grammar 


Mm. 


1 O 

.13 


.13 


1 o 

.18 


.61 


.63 


.57 




Med. 


.45 


.43 


.51 


.88 


.89 


.84 




Max. 


.68 


.64 


.76 


1.07 


1.04 


1.04 


Writing 


Min. 


.16 


.08 


.20 


.57 


.57 


.54 




Med. 


.41 


.38 


.49 


.77 


.78 


.74 




Max. 


.64 


.62 


.71 


1.13 


1.14 


1.12 


Grammar & Writing 


Min. 


.21 


.22 


.29 


.60 


.66 


.60 




Med. 


.42 


.38 


.48 


.85 


.85 


.83 




Max. 


.77 


.63 


.79 


1.20 


1.28 


1.27 


Grammar 


Min. 


.28 


.27 


.35 


.57 


.58 


.56 


& Literature 


Med. 


.47 


.46 


.55 


.81 


.81 


.76 


& Writing 


Max. 


.62 


.65 


.71 


1.12 


1.15 


1.10 


Grammar & Reading 


Min. 


.18 


.31 


.37 


.63 


.59 


.59 


& Writing 


Med. 


.47 


.41 


.52 


.82 


.84 


.79 




Max. 


.54 


.51 


.61 


1.10 


1.09 


1.08 
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TABLE 8 



Distribution, Across Colleges, of Multiple Correlation 
and Standard Error of Estimate in Predicting Mathematics Grades 



Multiple correlation Standard error of estimate 

ACT sub- High school ACT subtests and ACT sub- High school ACT subtests and 

Course group Quant ile tests only grades only high school grades tests only grades only high school grades 



Algebra 


Min. 


.08 


.14 


.17 


.86 


.82 


.78 




Med. 


.39 


.42 


.51 


1.13 


1.10 


1.05 




Max. 


.65 


.67 


.77 


1.42 


1.44 


1.41 


Calculus 


Min. 


.20 


.25 


.35 


.80 


.83 


.79 




Med. 


.36 


.39 


.48 


1.05 


1.05 


1.01 




Max. 


.63 


.53 


.64 


1.30 


1.26 


1.25 


Computer Science 


Min. 


.30 


.20 


.39 


.95 


.94 


.92 




Med. 


.39 


.36 


.46 


1.03 


1.04 


.99 




Max. 


.48 


.62 


.63 


1.38 


1.43 


1.38 


Accounting 


Min. 


.32 


.29 


.39 


.83 


.81 


.77 




Med. 


.43 


.46 


.56 


1.09 


i.14 


1.07 




Max. 


.62 


.61 


.71 


1.45 


1.35 


1.36 


Algebra 


Min. 


.27 


.20 


.33 


.94 


.95 


.92 


& Arithmetic 


Med. 


.39 


.38 


.47 


1.17 


1.20 


1.14 


Skills 


Max. 


.62 


.54 


.71 


1.38 


1.41 


1.36 


Algebra 


Min. 


.22 


.15 


.26 


.88 


.87 


.83 


& Trigonometry 


Med. 


.38 


.43 


.53 


1.13 


1.07 


1.03 




Max. 


.48 


.54 


.63 


1.35 


1.36 


1.37 


Analytic Geometry 


Min. 


.25 


.27 


.37 


.85 


.81 


.80 


& Calculus 


Med. 


.38 


.39 


.50 


1.13 


1.16 


1.10 




Max. 


.51 


.58 


.62 


1.34 


1.37 


1.28 



TABLE 9 



Distribution, Across Colleges, of Multiple Correlation 
and Standard Error of Estimate in Predicting Social Studies Grades 



Co ur se g r o up 


Ouant ile 


Multiple correlation 






Standard error of estimar 


3 


ACT sub- 
tests only 


High school 
grades only 


ACT 
high 


subtests 

o f*\t nn 1 
ovllUU L 


and 

jjldQCo 


ACT sub- 
tests only 


Hish school 
grades only 


ACT 
high 


subtests and 
scnooi graces 


History 


Min. 


.03 


. 19 




.32 




.55 


.55 




.54 




Med. 


.49 


.44 




.55 




.93 


.96 




.89 




Max. 


.68 


.67 




.74 




1.31 


1.21 




1 9ft 


Psychology 


Min. 


.23 


.22 




.32 




.54 


.52 




.51 




Med. 


.49 


.44 




.56 




.91 


.95 




.90 




Max. 


.71 


.63 




.75 




1.28 


1.28 




1.26 


Sociology 


Min. 


.08 


.25 




.35 




.62 


.71 




.62 




Med. 


.42 


.37 




.50 




.87 


.92 




.83 




Ma.. 


.67 


.51 




.71 




1.20 


1.21 




1.17 


History 


Min. 


.31 


.25 




.38 




.88 


.88 




.84 


& Political 


Med. 


.49 


.38 




.52 




.92 


.97 




.89 


Science 


Max. 


.54 


.44 




.59 




J..13 


1.14 




1.11 



TABLE 10 



Distribution, Across Colleges, of Multiple Correlation 
end Standard Error of Estimate in Predicting natural Sciences Grades 



Multiple correlatic. Standard error of estimate 

ACT sub- High school A( subtests and ACT sub- High school ACT subtests and 

Course group Quant ile tests only grades only high school grades tests only grades only high school grades 

Biology Min. .19 .09 .29 .41 .61 .44 

Med. .51 .49 .61 .95 .97 .90 

Max. .93 .73 .93 1.49 1.37 1.32 



Chemistry Min. .27 .17 .31 .71 .71 .7 

Med. .46 .46 .56 .95 .98 .92 

Max. .66 .75 .82 1.36 1.33 1.23 



^ r 
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Correlations between predictive validity statistics and mean test scores and 
grades . Neither mean course grade, mean ACT Composite score, nor mean high school 
average was significantly correlated (p < .10) with multiple R across all course 
groups. Moreover, for no course group was multiple R significantly correlated with 
all course characteristics. The correlation coefficients typically ranged between 
-.20 and .30. 

We found somewhat stronger relationships between these three course character- 
istics and SEE. Correlations of these variables with SEE varied from -.30 to -.54 
for the English course groups, ,00 to -.45 for mathematics, -.20 to -.55 for social 
studies, and -»2j to -.50 for natural sciences. For the Accounting course group, 
the three correlations ranged from -.58 to -.82; for Analytic Geometry & Calculus, 
they ranged from -.57 to -.92. Thus, higher levels of general educational develop- 
ment in a specific course group, as measured by mean course grade, ACT Composite 
score, or high school average, were generally associated with more accurate predic- 
tions for that course group, as measured by SEE, though not as measured by multiple R. 
Note that this statement pertains to courses within specific course groups; it is 
not true across course groups. 

Part 2 (Crossvalidation Analysis) 

For each course within each of 10 course groups, we computed the differences 
between the crossvalidated correlation (CVR) and base year multiple R, and between 
the crossvalidated oot mean square error (RMSE) and base year standard error of 
estimate (SEE). These statistics measure the change in prediction accuracy when a 
prediction equation from the base year data is applied to freshmen in future years. 
We also computed for each course the average difference between the predicted grade 
and actual grade earned (BIAS). Positive values of BIAS indicate overprediction, 
and negative values indicate underprediction. We then summarized these statistics 
across the courses within each course group. 

Table 11 contains, for each course group, the medians of the differences CVR-base 
year R, and RMSE-SEE, and the median BIAS. Because the results for the ACT and HSH 
prediction models were very similar to those of the ACT + HSG model, we have reported 
only the results for the ACT * HSG model. 

As shown in Table 11, their* was typically a slight decrease in R from base year 
to crossvalidation year. The largest differences between CVR and base year R occurred 
in Calculus (-.08) and in Grammar & Literature & Writing (-.08). Conversely, there 
was no change in R for Grammar and very small differences were found for Psychology 
and Biology. 

Table 11 shows that the RMSEs for almost all of the course groups were typically 
somewhat larger than their corresponding SEEs. Algebra, Calculus, and Chemistry had 
the largest median increase in errors of prediction (.06); Grammar & Literature & 
Writing, Writing, and History had only a slight median increase (.02 to .03) in pre- 
diction errors; and Grammar had no median change. 

The results for crossvalidated BIAS show that course grades were typically over- 
predicted for Grammar & Literature & Writing, Algebra, Calculus, and Biology, with 
median BIAS ranging from .06 to .20. The largest median BIAS was found for Calculus 
(.20). The grade predictions for the other course groups typically had biases near 
zero. 



ERLC 



TABLE 11 



Median Differences Between Crossvalidation Year and Base Year Statistics 

for the ACT + *.<C Prediction Model 



Number of students 



Course grou p 



Number of 
colleges 



Median statistic 



Base 
yea r 



Cross val. 
year 



Grammar 11 

Writing 22 

Grammar & Writing 27 

Grammar 

& Literature 12 
& Writing 

Algebra 29 

Calculus 10 

History 1/ 

Psychology 23 

Biology 31 

Chemistry 26 



525 
513 
308 

532 

183 
203 
168 
299 
161 
183 



493 
578 
320 

435 

244 
207 
160 
313 
196 
188 



Crossval. R Crossval. RMSE 
base year R - base jAt SEE 



.00 
-.05 
-.05 

-.08 

-.06 
-.08 
-.07 
-.03 
-.02 
-.05 



.00 
.02 
.04 

.03 

.06 
.06 
.03 
.04 
.04 
.06 



-.03 
.01 
-.00 

.07 

.08 
.20 
-.01 
-.01 
.06 
.03 
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In summary, a small decrease in prediction accuracy was found between the base 
year and crossvalidation year, as measured by CVR-base year R and RMSE-SEE. Algebra, 
Calculus, and Chemistry showed some decrease in accuracy as measured by both CVR and 
RMSE; Calculus also had a relatively large median BIAS. Grammar, on the other hand, 
showed virtually no decrease in prediction accuracy. 

Institutions 1 Uses of Prediction Equations 

We included an additional item, concerning institutions' use of SRS data, in 
the questionnaire we sent to the SRS users (see Appendix B). Of the 233 institutions 
that responded to this item, 65 (or 28Z) indicated they use SRS information in one 
way or another for placement aui sectioning. Seventy-eight institutions (33Z of the 
respondents) identified other uses they made of SRS information. The other uses 
identified were: counseling/advising (17Z), admissions/general measure of readiness 
(3Z), planning/research/statistical review (6Z), and instructor/administrator infor- 
mation (3Z). The remaining 90 institutions (39Z) did not identify how they used SRS 
information. 

Of the 2,812 specific course predictions developed by all institutions through 
their participation in SRS, 252 (or 9Z) were explicitly used for placement and sec- 
tioning: 44Z were L English; 33Z were in mathematics; 11Z were in Social Studies; 
10Z were in natural sciences; and 3Z were in miscellaneous. 

One b culd k.ep in mind when interpreting these statistics that they pertain 
only to the SRS user institutions that developed specific course predictions. McNabb 
(1987) surveyed more general classes of ACT-participating institutions about their 
course placement practices. She found, for example, that 34Z of all ACT-participating 
institutions use individual ACT test scores directly (rather than grade predictions 
based on ACT scores and high school grades) for placement. 

Summary and Conclusions 

For every course group, predictions based on ACT test scores alone had equiva- 
lent or higher median multiple Rs than predictions based on self-reported high school 
grades alone. Moreover, the combined AC! test score and high school grade prediction 
model had higher median multiple Rs and smaller SFEs than both the ACT or high school 
grade models. Therefore, only the results for the combined model will be sunmarized 
hi -e. 

In comparing the prediction results across subject areas, we noted that pre- 
diction accuracy, as measured by median multiple R, was fairly constant across all 
courses in the English, mathematics, and social studies course groups (.46 to .56). 
Somewhat larger median multiple Rs were obtained for natural sciences (.56 to .61). 
There was greater variability, however, in the corresponding SEEs. SEEs ranged from 
.74 to 1.14, with the greatest prediction accuracy obtained for the English course 
groups (median SEE = .74 to .84) and the least prediction accuracy for the mathe- 
matics course groups (median SEE ■ .99 to 1.14). 

Engli sh 

Prediction accuracy, as measured by median multiple R and SEE, was very similar 
for all of the English course groups (median multiple R = .48 to .55; median SEE = .74 
to .84). The greatest predictive accuracy occured in Grammar & Literature & Writing 
courses (multiple R = .55; SEE = .76). Prediction accuracy appeared to remain fairly 
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stable on crossvalidation, with only a slight decrease in multiple R, a slight increas 
in SEE, and little or no prediction bias (except for Grammar £ Literature & Writing, 
which tended to be overpredicted) . 

The median mnltiple Rs for the English course groups were consistently larger 
than those reported in earlier studies* Gorrell (1983) obtained a larger multiple R 
of .61, but the criterion variable he used was not a course grade, but an essay 
rating. The median multiple Rs for English course groups were somewhat lower than 
those obtained in predicting overall GPA (TH Index median multiple R = .568), as 
given in the SRS Summary Tables (ACT, 1985). The SEEs also tended to be somewhat 
larger than those for overall GPA (TH Index median SEE = .67). 

Mathematics 

There was greater variation in predictive accuracy among mathematics course 
groups (mMian multiple R = .46 to .56; median SEE ■ .99 to 1.14). The greatest 
predictive accuracy was found for Algebra & Trigonometry and for Accounting; the 
least predictive accuracy was found for Algebra a Arithmetic Skills. On cross- 
validation, the Algebra and Calculus course groups showed some decrease in median 
multiple R and an increase in SEE; grades in these courses also tended to be over* 
predicted. (Crossvalidation statistics were obtained for only these two mathematics 
courses). 

While the median correlations for the mathematics courses in this study were 
similar to the median correlation from the earlier studies that examined mathematics 
grades, there was a large range of correlations reported in the earlier studies. 
Gussett (1974), for example, obtained multiple Rs of .63, which is near the high end 
of the distribution of correlations we found for the mathematics course groups. His 
results might be attributed to the fact that his saaple was composed of women from a 
single institution; the grades of women are more predictable than those of men 
(Munday, 1967). 

In comparison to the SRS Summary Table statistics for predicting overall GPA, 
smaller multiple Rs and larger standard errors were obtained for the mathematics 
course groups. An explanation of why this occurred is given later in the paper. 

Social Studies 

The results for social studies courses indicated a fairly consistent degree of 
predictive accuracy across the course groups (median multiple R * .50 to .56; median 
SEE " .83 to .90). 

The multiple Rs for the social studies course groups were similar to the median 
multiple R for overall GPA, as reported in the SRS Summary Tables. The median SEEs 
for all the social studies course groups, however, were larger than the median SEE 
fo overall GPA. 

Natural Science 

Predictive accuracy, as measured by SEE, was fairly similar for the two natural 
sciences courses (median SEE = .90, .$<!). However, the median multiple R for Biology 
(.61) was slightly higher than that for Chemistry (.56). The crossvalidation results 
indicated only a small decrease in predictive accuracy, and a tendency for Biology 
grades to be slightly overpredicted. 
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We found greater predictive accuracy for Biology tnan Schoenfeldt & Brush (1975). 
The results for Chemistry were consistent with those of Reiner (1971), who used a 
similar prediction model (ACT scores plus high school grades). The median multiple 
R for Biology was larger than the SRS Summary Table multiple R for overall GPA, and 
the median SEE was larger than the SEE for overall GPA. 

Factors Related to Variation in Predictive Va? idity Statistics 

One can attribute prediction error to three general sources: unreliability in 
the predictors, unreliability in the criterion, and imperfect relationships between 
the true scores of predictors and criterion. We shall examine the differences in 
the predictive validity statistics with respect to this interpretation. 

The ACT Assessment Program Technical Manual (ACT, 1987) reported mean KR20 
reliabilities of ACT test scores over 15 forms of the ACT Assessment administered 
between 1983 and 1986. These mean reliabilities ranged from .84 tc .91 for the four 
subtests. 

Rather limited evidence is available on the reliability of self-reported high 
school grades. The accuracy with which students report courses taken and grades 
received was studied by Valiga (1987), who found a correlation of .93 between non- 
certified self-reported grades and grades from students' transcripts. "Test-retest" 
reliability of grades was estimated by Bligh (1968), who found a correlation of .96 
between students 1 grades reported over a 2-week time interval (N=440). 

Although the reliability of college freshman GPA has been estimated to be between 
.80 and .82 (Munday, 1970; Millman, Slovacek, Kulick, and Mitchell, 1983), the relia- 
bility of specific course grades has proven to be difficult to determine. As students 
Jo not typically retake courses unless required to do so, "test-retest" reliability 
estimate are not feasible. The research on _he reliability of specific course grades 
is some* at limited as a result. Where such studies have been pursued, it has been 
assumed that grades in different courses could be treated as repeated measurements of 
a single domain, so tl&l an overall GPA reliability could be stepped down, via a 
reverse Spearman-Grown formula, to a single course reliability coefficient. We found 
.wo such studies, which reported single course reliabilities of .30 and .44 (Etaugh, 
Etaugh, and Hurd, 1972) and .39 to .76 (Schoenfeldt and Brush, 1975). Schoenfeldt 
and Brush reported reliabilities for 12 specific course areas, including reliabili- 
ties of .39 for Speech/ Journal ism, .72 for humanities, .36 for social sciences, .64 
j. : or biological sciences, and .75 for physical sciences. Not* that the reliabilities 
of single course grades are typically lower than those reported for overall GPA. If 
these estimates are reasonably accurate, then one cannot expect correlations between 
single ACT scores and course grades to exceed .85 (assuming ACT subtest reliabilities 
of .96 and course grade reliabilities less than .75). Assuming more typical relia- 
bilities of .88 for the ACT subtests and .44 for course grades, correlation coeffi- 
cients could not be expected to exceed .62. 

The strength of the relationship between ACT test scores, high school grades, 
and freshman course grades will also be influenced by the degree of content overlap 
among the three measures. Though the ACT tests may not measure all of the knowledge 
and skills required for a specific college course, it is likely that for many fresh- 
man courses the tests measure a majority of the most important/necessary skills and 
knowleOfc?. This will result in a strong relationship between ACT test scores and 
students performance in such courses. If the ACT tests do not directly measure a 
required skill or knowledge, they may measure a closely-related one; for students in 
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these courses, we could expect a significant relationship between the two sets of 
skills and/or knowledge* 

Multiple R is also influenced by the variability in both the predictors and the 
criterion; by increasing their heterogeneity, multiple R will increase (Nunnally, 
1978). Conversely, if the variability in the predictors or criterion is restricted, 
then multiple correlations will decrease. In practice, the variability in ACT scores! 
high school grades, or course grades may be affected by preselection, placement , or 
college grading practices. 

Given a fixed value of multiple R, SEE increases as the criterion standard devia- 
tion increases. For criterion/predictor relationships with homoscedastic errors, SEE 
is not directly affected by changes in the standard deviation of the predictors. 

The SRS Summary Tables report a standard deviation of .86 for overall freshman 
CPA among students nationally. We found that the standard deviations of specific 
course grades were much larger, vith median values of .87 to 1.28 across the 18 course 
groups. Among the subject areas, mathematics course grades had the largest standard 
deviations (median values 1.12 to 1.28). 

The standard deviation of ACT Composite score in the SRS Summary Tables is 5.64, 
which is considerably larger than the median standard deviations of 3.59 to 4.89 for 
the 18 course groups. The mathematics course groups tended to have smaller median 
ACT Composite score standard deviations (3.59 to 4.54) than those of the other course 
groups. 

The standard deviation of high school average in the SRS Summary Tables is .64, 
which is also larger than most of the median standard deviations for the 18 course 
groups (.48 to .65). The mathematics course groups again tended to have smaller high 
school average standard deviations (.48 to .61). 

It appears, therefore, that greater prior selection has occur d for students 
in the mathematics courses represented in this study than for students in the other 
course groups. This prior selection may have occurred either through actual place- 
ment or through students 1 self-selection, but in either case, tended to decrease the 
standard deviation of their ACT scores and high school grades. 

In addition, grading standards appear to have been mo^e stringent in mathematics 
courses than in other courses. As shown in Tables 3 through 6, the median average 
ACT Composite scores and high school averages for the mathematics course groups were 
typically higher than those of other course groups. At the same time, the median 
course grade means for mathematics were typically lower than these of other course 
groups. The larger mathematics grade standard deviations suggest that the more 
stringent grading standards are the result of a larger proportion of very low grades 
and a smaller proportion o middle or average grades, rather than the result of a 
uniform shift to lower gra es. 

The median multiple Rs for some of the mat-hematics course groups wi e smaller 
than the median multiple Rs for the other course groups. This is probably due, at 
least in part, to the effects of prior selection, as expressed through smaller 
deviations of the predictor variables. 

The median standard errors of estimate for all of the mathematics course groups 
were considerably larger than the median standard errors of estimate for the other 
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course groups. This is a direct effect of the much larger course grade standard 
deviations, the result of more stringent grading. 

The ACT Mathematics Usage test is constructed according to the same procedures 
used for the other subtests; in particular, the same effort is made to ensure a 
close match between its content and the rkills and knowledge required fo*: typical 
freshman mathematics courses. Moreover, the typical reliability of the ACT mathe- 
matics subtest is very similar to that of the other subtests. It is unlikely, there- 
fore, that the lesser predictive accuracy for the mathematics course groups is the 
result of either the content or the length of ACT mathematics subtest. The lesser 
predictive accuracy is more likely due to greater prior selection and to the charac- 
teristics of the mathematics course grades themselves. 

Results for Different Types of Institutions 

Mean course grades, mean ACT Composite score, and mean high school average of 
courses were generally not significantly related to better or worse specific course 
grade predictions as measured by multiple R. There was a stronger relationship 
between the standard errors of estimate and mean course grades, mean AJT Composite 
scores and mean high school averages. Courses in which students had relatively high 
average ACT Composite scores and high school averages appeared to obtain greater 
predictive accuracy, as measured by SEE, than courses with low averages. This was 
particularly the case for Accounting and Analytical Geometry & Calculus grade pre- 
dictions. 

Further analyses revealed that courses whose students had relatively high mean 
ACT Composite scores tended to have less variation in their grades than did courses 
with low ACT Composite scores. With similar multiple Rs, as was observed here, one 
would expect that the SEEs for courses with high mean ACT Composite scores would, as 
a result, also be smaller. 

Implications for Course Placement 

Institutions sometimes base their placement decisions on single ACT subtest 
scores, on the four ACT subtest scores alone, or on high school grades alone. As we 
have noted earlier, the full eight-variable prediction model (the four ACT subtest 
scores and four self-reported high school grades combined) should be used to maxi- 
mize the accuracy of placement decisions. 

The degree to which students have been preselected on the basis of ACT test 
scores and/or high school grades, either for placement purposes or admissions, will 
affect the predictive accuracy of specific course grade predictions. Preselection 
typically results in underestimates of the strength of the relationship between the 
predictors and the criterion in the unselected population. 

The multiple Rs and standard errors of estimate reported here do not fully 
measure the validity of placement decisions for specific courses. As we indicated 
earlier, this would require knowing the overall failure rate that would occur with- 
out course placement, the selection rate for each course, the benefit!! in making 
correct placement decisions, and the costs incurred in making incorrect ones. 
College researchers can make some assumptions about failure and selection rates, 
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though, and can estimate from correlation coefficients the resulting proportions of 
correct and incorrect decisions* 

Finally, one must note that there is variability in the predictive accuracy of 
specific course grade predictions within each course group, as well as across course! 
and subject areas* As a result, local course grade prediction equations need to be 
developed to be assured of maximum predictive accuracy and correct placement decisioi 
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Appendix A 

Taxonomy of Specific Courses Codes 



ERIC 



49 



34 



ACT Standard Research Service 
pacific Course 3ra<fe Prediction Survey 

CODE LIST 



COURSE CONTENT 



ENGLISH: 



FOREIGN LANGUAGES: 



El - 

E2 - 

O - 

E4 - 

a - 

E6 - 



Grammar/Linguistics 
Literature (American, English, 
Classics, etc.) 
Reading 

Speech (public speaking, rhetoric, 
oral interpretation, etc.) 
Writing (creative, expository, 
journalism, etc.) 
Other (please specify on 
questionnaire) 



SOCIAL STUDIES ; 

51 - Anthropology (cultural, 

physical) 

52 - Archaeology 

53 - Economics 

54 - Geography 

55 - History (American, World, 

Western Civilizations, etc.) 

56 - Law 

57 - Political Science (world 

problems, theory, etc ) 
SB - Psychology (child, abnormal, 

adult, etc.) 
S9 - Religion 

510 - Sociology 

511 - Other (please specify ^n 

questionnaire) 

512 - Intro to Business*/Business* 

513 - Social WelfareVSocial 

Work 



Fl 


- Chinese 


Ml 


F2 


- French 


M2 


F3 


- German 


M3 


F4 


- Italian 


H4 


F5 


- Japanese 


16 


F6 


- Russian 




F7 


- Spanish 


m 


F8 


- Other (please 


M7 




specify on 


MB 




questionnaire) 


M9 



MATHEMATICS ; 

- Algebra 

- Analytic Geometry 

- Arithmetic Skills 

- Calculus 

- Computer Science/ 
Numerical Analysis/Graphics* 

- Geometry 

- Logic 

- Statistics/Probability 
Trigonometry 

Other (please specify on 
questionnaire) 
Mil - Pre CalculusVFinite Math 
Linear Algebra* 



MIO 



M12 



NATURAL SCIENCE; 


MISCELLANEOUS: 


Nl 


- Anatomy/Physiology 


XJ 


' £':countin~ 


N2 


- Astronomy 


X2 


- Architecture 


N3 


- Biology/Life Sciences/Microbiology* 


X3 


- Art 


m 


- Botany/Plant Science* 


X4 


- Drama 


N5 


- Chemistry (organic, inorganic, 


X5 


- Management/ 




analysis, etc.) 




Administration 


N6 


- General Science 


X6 


- Music 


N7 


- Geology 


X7 


- Study Skills 


NB 


- Health Sciences (Nursing, 


XB 


- Teacher 




Medicine, Pharmacology, 




Education 




Veterinary Medicine, etc.) 


X9 


- Philosophy* 


SJ 


- Meteorology 


XIO 


- ResearchVLibrary 


N10 


- Physics, Biophysics/Mechanics* 




Use* 


Nil 


- Zoology 


Xll 


- Navigation* 


N12 


- Otfr r (please specify on 


X12 


- Humanities* 




questionnaire) 


X13 


- History of Art* 


NO 


- Physical Science* 


X14 


- Agriculture* 


N14 


- Conservation* 'Ecology* 






N15 


- Engineering* 







DISCIPLINARY EMUASIS (there applicable) 

1 - Agriculture 

2 - Business 

3 - Engineering 

4 - Health Sciences 

5 - Other (please specify on questionnaire) 

6 - Architecture* 

7 - Education* 

8 - Technical* 



* Added following the survey administration 
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Date 




Name 

Institution name 
Address 

City, State Zip 
Dear : 

An important feature of ACT's Standard Research Service (SRS) is the ability 
to develop prediction equ*tic s for grades in specific freshman cou.. es, as 
well as for overall freshman GPA. I note from our records that your 
institution has utilized this feature of SRS over the past several years. I 
hope you have found it to be useful in developing course sectioning and 
placement policies. 

We have, in the last several years, received requests for validity data about 
specific kinds of freshman courses, sue* as writing or college algebra or 
history. We have data in our SRS magnetic tape files on hundreds of specific 
courses. Unfortunately, the information we collect from colleges when they 
design their SRS specific course grade predictions is often not informative 
enough to determine exactly what kind of course is being studied. 7or 
example, a college may simple designate its mathematics course as "Mathematics 
150" or just "Freshman Math"; we cannot tell jist from these names very much 
about the content of the courses. 

To address this need, we have decided to survey SRS participants from the past 
four years to learn more about the kinds of specific courses they have been 
using for course grade predictions. I have enclosed a roster that lists the 
specific courses your institution has studied. Would you please take the time 
to tell us the content of these courses? Complete, detailed instructions for 
filling out the forms are enclosed. If you are no longer supervising your 
institution's participation in SRS, please pass these materials on to the 
appropriate person. 

I know that time is at a premium for all our users, but I do hope you will be 
able to complete the enclosed form. I am confident that you will find it very 
easy to fill out. I will send you an advance copy of the results as soon as 
they are available. 

If you have any questions or concerns, please call either Julie Noble at 
319/337-1442 or Richard Sawyer at 319/337-1101, collect. On behalf of ACT and 
the colleges that use the Standard Research Service, thank you in advance for 
your generous help. 

Sincerely, 



James Mazey, Director and 

Senior Research Scientist 
Institutional Services 
Research Division 
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2201 North Dodge Street P.O Box 168 
Iowa City, Iowa 52243 

(319) 337-1000 




ACT Standard Research Service 
Specific Course Grade Prediction Survey 



DIRECTIONS 



Between 1980 and 1984 your institution participated in ACT's Standard Research 
Service (SRS). As part of your SRS analyses, you requested the prediction of 
grades in several of your specific courses. We have listed all these courses 
on the attached questionnaire. 

The first column on the questionnaire is a Sequence Number, which we have used 
to identify your courses. Following the Sequence Number, the subgroup, course 
name, J-count (sample size) and SRS subject area for each course are listed 
by year. Subgroups are identified either by Lhe letter 's' (for Summary 
Group) or by a number between 1 and 9. The SRS subject area is coded as 
follows: E ■ English, M = Mathematics, S = Social Studies, and N = Natural 
Sciences. This information was taken directly from your SRS Report(s). 

Please begin by writing your name and telephone number in the spaces provided 
at the top of the questionnaire. (We would like to be able to call you if we 
need further clarification.) Then, verify the subgroup, course name, N-count, 
and SRS subject area of each course against the appropriate SRS report for 
your institution. Finally, for each course within each year, please supply 
the information requested below. (An example has been provided on page 3.) 



Content Codes 

Please refer to the course content code list attached to this survey. Then, 
circle the appropriate code(s) on the questionnaire that best identify the 
course content. Circle all relevant course content codes. If you circle a 
code corresponding to "Other", please write a brief description of the course 
in the space provided. 

The course content codes we have provided might not correctly identify the 
content of a course; if the odes supplied are inappropriate, cross them 
out. In some cases we could not determine the exact subject area of a ~ourse, 
and so we left the code section blank. In either case, consult the code list 
and write in the code section all the codes that are appropriate. (Be sure to 
note the Miscellaneous codes we have provided on the code list.) If you 
cannot locate an appropriate content code, please write a brief description of 
the course. 

The following sources of information may be helpful in determining the 
appropriate course content codes: 

* College catalog of courses 

* Your own internal documents related to SRS 

* Departmental personnel 

Please try to determine the course content codes for every course listed on 
the questionnaire, particularly those with nonspecific names (e.g., 



Course Content 



'English 1 





Pooled Grides 



Colleges often pool the grades of students enrolled in different courses and 
report them under a single SRS subject area. [tor example, the grades of 
studc :s enrolled in Biology, Chemistry, or Anatomy might be pooled under 
"Nat- ral Sciences 11 ,) If your institution has done this, please circle all the 
relevant course content codes for all the courses. Then check the ^Pooled" 
column to indicate your data were pooled. 

CPAs 

Instead cf reporting a specific course grade for each Ltudent, colleges 
sometimes report a grade point average (GPA) computed from several courses. 

* If a course listed on your questionnaire represents a GPA of more than 
one related course (e.g., first and second semester English GPA), 
circle all the relevant course content codes, and check the columr 
labelled "GPA" • 

* If a course listed on your questionnaire represents an overall GPA of 
several unrelated courses, leave the course content section blank, and 
check the column labelled "GPA". 

Primary Content 

Using the codes you selected for course content, write in the one or two 
course content codes that best describe the primary content of each course. 

Plcceaent Level 

Colleges often have courses into which students with particular levels of 
preparation or ability are placed: 

*Dfc -These courses provide skills and information typically acquired by 
students before thev enroll at your institution. They are often 
designated as Developmental or Remedial courses. 

*ST -These courses require skills and information typical of students 
following the standard curriculum sequence at your institution. They 
are the courses usually taken by most of your students. 

*HO - These courses require skills and information beyond those of the typical 
freshman student at your institution. They are often designated as 
Honors courses. 

For each course, circle the one code (DR, ST, or HO) that best describes its 
placement level. 
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Disciplinary Zmphasi s 



Colleges of Agriculture, Business, Engineering, or Health Sciences frequently 
offer courses in writing, art, or mathematics with emphasis on the specific 
college or discipline. The disciplinary emphasis codes have been included to 
help identify such courses. For example, Business Math may have content 
similar to that of the typical Algebra I course, and as such, should have 
similar course content codes. However, because the material in the course * 
emphasizes business applications, "Business" (Code 2) should be indicated as 
the disciplinary emphasis of the course. 

Where aopropriate, please circle the code that identifies the disciplinary 
emphasis of the course. If you select the "Other" category (Code 5) for 
Disciplinary Emphasis, please write a brief description to clarify the exact 
nature of the course. Most courses will not have a disciplinary emphasis and 
so thip area will usually be left blank. 

Uses of SRS Data 

We also want to determine how the information in SRS reports is used. An 
additional question has been included at the end * the questionnaire to 
address this issue. Please be as specific as possible in identifying your 
uses of the specific course grade information provided in the SRS report. 



A sample questionnaire is provided on tne next page to illustrate the steps 
involved in filling out the questionnaire. If you have additional questions, 
please call Julie Noble (319/337-1442) or Richard Sawyer (319/357-1101) 
collect. Please return the questionnaire in the enclosed envelope by November 
15, 1985. Thank you very much for your cooperation. 




A Sample Questionnaire 



John Allen from Congressional College participated in ACT's Standard Research 
Service in 1980-81. "Freshman English" and "Mathematics" were designated as 
course grade criteria in the SRS report for his institution, "Freshman 
English" was identified for the summary group, with an N-count of 200; 
"Mathematics" was identified for Subgroup 1, with an N-count of 125. The 
documentation of this information would appear as follows on the 
questionnaire: 



Seq. 
No. Tf> 



80*81 



Sib- Oaam 
gray fkma 



Qmne QKck. 



Que Am Qxka 



f\ tshnn EngtUh 



WO 



125 



El E2 E3 E4 ES E6 
Cement": 



HI NZ M3 M4 MS Hb 

hj m m Mio 

Camnu: 



Uwi Jf deck If Prlmry Nnruu* Urn Ipllmcy 



m at id 



I 2 3 4 5 



12 3 4 5 



To determine the content of the course "Freshman English", John Allen referred 
to internal documents related to the SRS and conferred with the English 
Department staff. He found that chis course was an introductory English 
course emphasizing English literature, writing, and grammar. The subject 
matter of the course was predominantly English literature and writing. To 
complete the questionnaire, John Allen first went to the course content code 
list, and determined that the appropriate codes for English literature, 
writing, and grammar were E2, E5, and El, respectively. He then circled these 
codes in the course content code section of the questionnaire. The grades 
reported under "Freshman E^j.ish" were from students enrolled in a single 
course; therefore, the "Pooled" and "GPA" columns were left blank. As Fnglish 
literature and writing comprised the primary content of the course, their 
codes (E2 and E5) were written in the primary content area. As the course was 
a standard freshman course f "ST" was circled under the placement level section 
of the questionnaire. The course did not emphasize a specific discipline and 
so the disciplinary emphasi* column was left blank. 

The next course is an example of an irregular situation. The second course 
name listed in the SRS Report for Congressional College was "Mathematics '• 
Therefore, mathematics codes (M1-M10) were provided in the content code 
space. John Allen determined from reviewing his internal records that the 
grades reported in this area were not for a mathematics course at all, but 
were first-year English GPAs for students enrolled in a two-semester remedial 
reading and writing program. To complete the questionnaire, John Allen marked 
out the mathematics content codes we provided and wrote in the English codes 
E3 and E5, together with an explanation of the situation. The grades were not 
pooled from students enrolled in different courses, so the "Pooled" column was 
l.ft blank. As the grades were fiist year English GPAs, John Allen checked 
the "GPA" column. The primary content of the course was noted as E3 and E5. 
The code "DR" was circled in the Placement Level section, as the course was 
intended for students with reading and writing deficiencies. There was no 
particular disciplinary emphasis, so this column was left blank. 
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After completing the specific course grade information, John Allen answered 
the question on "Uses of SRS Data". SRS information for the course "Freshman 
English 11 was used in sectioning and placement at Coi ressional College. 
Therefore, John Allen circled the "Yes 11 response to this question and circled 
the Sequence Number (1) of the Freshman English course. SRS information for 
the remedial reading/writing GPA was not used in sectioning or placement, and 
so the Sequence Number (2) for tips course was not circled. 

The completed survey would appear as follows: 



ACT Slraidflnl Ucsisxdi Service 
Sijodflc Cnume Urnrie Pradlcdan 5 vey 
quest lasialre 

OolLegBCbto: 9m TourH» TftU flllin 

Collide !W: r.<iyiW,J Ci»Hiy . Rods (^1) 3V1-ICCO 



Course Content 



Sea. 

Mo. Tear 


SieV Course 


N- 


96 
Aira 


U>ta 


Clock if 
tooled 


Check If 
CPA 


Ptissry 

Content 


Flacamt 


Disciplinary 
fisjJarij 


cr 


80-81 


S 


FreshMn English 


700 


I 


fj) @ U £« (S) £6 










1 2 3 4 5 




















62^5- 


















Omenta: 










2 


80-81 


1 


ftithe«»tlCS 


125 


H 


hi — m? — fe — mi m m 
w in w ■ m» £3 . 

Co»«*s: £rVjU*Vv 








<gpsr ho 


12 3 4 5 



Urtee of 9B Ptats 



Does your Institution use SKS course grade lttforsstlun for course sectioning or placessnt? (Circle one response) 

e. tfmS Circle die Sequence tiaixr (first colum) of tin b. No. Whet use do you neks of SRS data on specific courses? 

specific courses listed Above tint you lnve usud In (please be specific) 

sectioning or plscewoit. 



a i 



ACT Standard Research Service 
Specific Course Grade Prediction Survey 
Questionnaire 



College Code: Your Name 

Phone 



III III Course Content 
Son | Siib-j Course 1 N- ISRS 1 Check If 
III III II 
No.l Year IGtoudI Name iCount lArea iCodes iPooledl GPA 


i i 

Primary | Placement (Disciplinary 
1 1 
1 Content 1 Level 1 Emphasis 


1 


81-82 


S 


ENGLISH 


1305 


1 E | El E£ E3 EH " E6 
j Comments: 








DR ST HO 


1 1 2 i 4 5 


2 


81-82 


s 


MATHEMATICS 


1072 

— 


M |M1 M2 M3 M*J M5 M6 
|M7 M8 M9 M10 
| Comments: 

— i 


! 


i 




DR ST HO 


12315 


3 


81-82 


s 


SOCIAL SCIENCE 


1186 


S I SI S2 S3 S4 S5 S6 
|57 S8 S9 S10 S11 
1 Comments: 








DR ST HO 


1 2 3 4 5 


4 


81-82 


— 

s 

1 

1 




NATURAL SCIENCE 


1251 


N |N1 N2 N3 N4 N5 N6 
|N7 N8 N9 N20 Nil N12 
j Comments: 








DR ST HO 


12 3 4 5 
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Uses or sqy n f t f 



Does your institution use SRS course grade informat ion for mure- *i t 

3 mu« information for course sectioning or placement?(Ci rcle one response) 

a. Yes. Circle the Sequence Number-first column) of the h u« uh»» 

spec fic courses listed ab./e that you have used in N lU?™ 8 !.!! 0 yoi \T! k ? ° r SRS data on specific courses? 

sectioning or placement. (please be specific) 
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